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(Q) Graphical user interface incorporating a horizontal panning workspace. 



@ The present invention provides apparatus and 
methods for use in computer display system, 
and in particular, display system s having 
object-oriented graphic user interfaces with 
overlapping windows. A display system includ- 
ing at least one central processing unit (CPU) is 
coupled through appropriate input/output (I/O) 
circuitry to input devices, such as a cursor 
control device. The CPU is further coupled to a 
hard disk drive for the storage of programs and 
data, and is coupled to a network through 
which the CUP may communicate with a variety 
of system resources such as editors, music 
synthesizers, graphic generators and the like. 
The CPU is also coupled to a display device on 
which the present invention's user interface is 
displayed. Utilizing the teachings of the present 
invention, a "real" and a "virtual" workspace is 
defined comprising the entire desktop available 
to a user. The real workspace constitutes that 
portion of the desktop visible to the user on the 
display at any one time. The virtual workspace 
comprises a predefined extension of the screen 
area of the display which is also available for 
use by the user. The virtual workspace consti- 
tutes that portion of the desktop which is not 
visible to the user at any one time. The real and 
virtual workspaces comprise the entire desktop 
available to the user for opening and manipulat- 
ing windows in the display system. In addition, 
windows may be selectively affixed to the de- 
sktop. Using the cursor control device, a user 
may pan horizontally over the desktop (both 
real and virtual). 
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The present invention relates to apparatus and 
methods for displaying graphic information, and more 
particularly, the present invention relates to a com- 
puter controlled display system for displaying and ma- 
nipulating overlapping windows of data on a desktop 
workspace. 

Over the past decade, a variety of graphic user in- 
terfaces have been developed to ease human inter- 
action with computer systems. Many display systems 
utilize metaphors in the design of the interface as a 
way of maximising human familiarity, and conveying 
information between the user and the computer. It is 
common for computer systems incorporating so-cal- 
led "object oriented" display systems to utilize multi- 
ple "windows" on a display in which combinations of 
text and graphics are disposed. The display systems 
utilize familiar metaphors, such as desktops, control 
panels, notebooks and the like, such that the inter- 
face takes advantage of existing human mental struc- 
tures to permit a user to draw upon the metaphor ana- 
logy to understand the requirements of the particular 
computer system. 

It is well know that designing around a familiar 
metaphor helps reduce human learning time. (See for 
example, Patrick Chan, "Learning Considerations in 
User Interface Design: The Room Model", Report CS- 
84-16, University of Waterloo Computer Science De- 
partment, Onatario, Canada, July 1984, and the ref- 
erences cited therein.) The ability to operate on im- 
ages or objects which relate the user to actual objects 
on, for example, a desktop, results in a stronger man- 
machine interface. (See for example, D.Robson, "Ob- 
ject Oriented Software Systems", BYTE, August 
1991, page 74, Vol.6, No.8; L.Tesler, "The Smalltalk 
Environment", BYTE, August 1981, page 90, Vol.6, 
No.8; and Smith, et al., "Star User Interface: An Over- 
view", National Computer Conference, 1982). 

Research in interface design using metaphors in 
man-machine interfaces may be applied to computer 
controlled editing systems to incorporate and inte- 
grate various production media resources, such as 
special effects, music, graphics and the like. In the 
case of an editing system, a variety of resources must 
be integrated, scheduled and coordinated with one 
another to obtain a complete multi-media product. 
Users of computer controlled editing systems are 
generally familiar with the individual resources and 
the coordination of those resources to develop a fin- 
ished product. Accordingly, the "windows" utilized in 
a video editing system may be designed such that the 
metaphor of the interface takes advantage of the 
knowledge of the user in operating discrete devices 
(for example, a video tape recorder or music synthes- 
izer). The window may, therefore, take the form of a 
control panel for the video tape recorder, which in- 
cludes the controls of play, reverse, record and the 
like. Similarly, the window may provide an area on 
the display screen in which movies, takes, or partic- 



ular scenes are displayed for the user to edit. 

One problem associated with many object-orient- 
ed graphic user interfaces, is that the display screen 
provides only a limited size workspace in which to op- 

5 erate on the windows. For example, in the case of a 
video editing workstation, windows corresponding to 
resource such as video tape recorders, music syn- 
thesizers, audio tape recorders and music mixers 
may be opened and operating concurrently on the 

10 display. Given the limited space of the display screen, 
the workspace (known as the "desktop") which is 
available to the user may become cluttered and con- 
fusing to operate. The user may be required to fre- 
quently move windows in the workspace to make 

15 room for other windows to be opened, or alter the pri- 
ority in which the windows are displayed and overlap 
one another to gain access to a desired window. 

As will be describe, the present invention pro- 
vides a method and apparatus for increasing the usa- 

20 ble workspace area in a window-based graphic user 
interface. The present invention provides a real and 
a virtual desktop comprising the entire workspace, 
and the ability of the user to pan horizontally across 
the entire area in a contiguous fashion. 

25 According to the present invention, there is pro- 

vided a computer display system including a central 
processing unit (CPU) coupled to a display having a 
display screen, such that data is displayed on said 
display screen in a plurality of windows, comprising: 

30 user interface generation means coupled to 

said CPU for displaying said data in said windows, 
said user interface generation means generating and 
displaying a user interface including a desktop having 
a visible portion and a virtual portion, wherein said 

35 visible portion corresponds to that portion of the said 
desktop currently visible on said display screen, said 
virtual portion corresponding to that portion of said 
desktop currently not visible to said user on said dis- 
play screen; 

40 panning means coupled to said CPU for selec- 

tively panning said desktop in at least two directions, 
such that said desktop pans in a direction selected by 
a user, and that portion of said desktop within said 
visible portion is visible to said user. 

45 The present invention provides apparatus and 

methods for use in computer display systems, and in 
particular, display systems having object-oriented 
graphic user interfaces with overlapping windows. A 
display system including at least one central process- 

50 ing unit (CPU) is coupled through appropriate in- 
put/output (I/O) circuitry to input devices, such as a 
cursor control device. The CPU is further coupled to 
a hard disk drive for the storage of programs and data, 
and is coupled to a network through which the CPU 

55 may communicate with a variety of system resources 
such as editors, music synthesizers, graphic genera- 
tors, and the like. The CPU is also coupled to a display 
device on which the present invention's users inter- 
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face is displayed. Utilizing the teachings of the pres- 
ent invention, a "real" and a "virtual" workspace is de- 
fined comprising the entire desktop available to the 
user. The real workspace constitutes that portion of 
the desktop visible to the user on the display at any 
one time. The virtual workspace comprises a prede- 
fined extension of the screen area of the display 
which is also available for use by the user. The virtual 
workspace constitutes that portion of the desktop 
which is not visible to the user at any one time. The 
real and virtual workspaces comprise the entire desk- 
top available to the user for opening and manipulating 
windows in the display system. In addition, windows 
may be selectively affixed to the desktop. Using the 
cursor control device, a user may pan horizontally 
over the desktop (both real and virtual). If a window 
has been affixed to the desktop, the window main- 
tains it position relative to the desk top, and appears 
to move relative to the user. If the window is not af- 
fixed to the desktop, it appears to "float" above the 
desktop and remains fixed relative to the user as the 
desktop is panned. 

The invention will be further described by way of 
non-limitative example with reference to the accom- 
panying drawings, in which:- 

Figure 1 is a functional block diagram illustrating 
one possible computer display system incorporating 
the teachings of the present invention. 

Figure 2 shows a representative display screen il- 
lustrating the virtual and real workspace comprising 
the desktop of the present invention. 

Figure 3 illustrates the graphic user interface of 
the present invention in which a system setup window 
has been opened and the window activation button is 
in the "UP" position. 

Figure 4 illustrates a horizontal panning of the 
desktop wherein the system setup window maintains 
a fixed position relative to the user and floats above 
the desktop. 

Figure 5 illustrates the graphic user interface of 
the present invention wherein the system set up win- 
dow activation button is down ("DN") and the audio 
mix activation button is "UP". 

Figure 6 illustrates the horizontal panning of the 
present invention wherein the system setup window 
has panned horizontally into the virtual workspace, 
with the desktop and the audio mix window remains 
in a fixed position relative to the user. 

Figure 7 illustrates panning left in the system il- 
lustrated in Figure 6. 

Figure 8 illustrates the continued left panning of 
the system illustrated in Figure 7. 

Figure 9 illustrates the present invention wherein 
three overlapping windows have been opened. 

Figure 10 illustrates the left panning of the sys- 
tem illustrated in Figure 9. 

Figure 11 conceptually illustrates the operation 
of the present invention panning left and right, and 



moving windows between the real and virtual work- 
space on the desktop. 

The detailed descriptions which follow are pre- 
sented largely in terms of display images, algorithms 

5 and symbolic representations of operations of data 
bits within a computer memory. These algorithmic de- 
scriptions and representations are the means used by 
those skilled in the data processing arts to most ef- 
fectively convey the substance of their work to others 

10 skilled in the art. 

An algorithm is here, and generally, conceived to 
be a self consistent sequence of steps leading to a de- 
sired result. These steps are those requiring physical 
manipulations of physical quantities. Usually, though 

15 not necessarily, these quantities take the form of 
electrical or magnetic signals capable of being stored, 
transferred, combined, compared, and otherwise ma- 
nipulated. It proves convenient at times, principally for 
reasons of common usage, to refer to these signals 

20 as bits, values, elements, symbols, characters, im- 
ages, terms, numbers or the like. It should be borne 
in mind, however, that all of these and similar terms 
are to be associated with the appropriate physical 
quantities and are merely convenient labels provided 

25 to these quantities. 

In the present case, the operations are machine 
operations performed in conjunction with a human 
operator. Useful machines for performing the opera- 
tions of the present invention include general purpose 

30 digital computers or other similar devices. In all cas- 
es, there should be borne in mind the distinction be- 
tween the method operations of operating a computer 
and the method of computation itself. 

The present invention relates to method steps for 

35 operating a computer and processing electrical or 
other physical signals to generate other desired phys- 
ical signals. The present invention also relates to ap- 
paratus for performing these operations. This appa- 
ratus may be specially constructed for the required 

40 purposes, or it may comprise a general purpose com- 
puter selectively activated or reconfigured by a com- 
puter program stored in the computer. The algorithms, 
methods and apparatus presented herein are not in- 
herently related to any particular computer. In partic- 

45 ular, various general purpose machines may be used 
with programs in accordance with the teachings here- 
in, or it may prove more convenient to construct more 
specialised apparatus to perform the required meth- 
od steps. The required structure for a variety of these 

50 machines will appear from the description given be- 
low. Machines which may perform the functions of 
the present invention include those manufactured by 
Sony Corporation of America, as well s other manu- 
facturers of computer systems. 

55 The present invention discloses apparatus and 

methods for displaying graphic or other information in 
a window-based system on a computer display. In the 
following description, numerous specific details are 
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set forth such as computer system configurations, 
window elements, icons, desktop sizes, metaphors, 
window configurations and arrangements, etc. in or- 
der to provide a thorough understanding of the pres- 
ent invention. However, it will be apparent to one skil- 
led in the art that the present invention may be prac- 
tised without these specific details. In other instanc- 
es, well known circuits, structures and the like are not 
described in detail so as not to obscure the present 
invention unnecessarily. 

Referring now to Figure 1, the hardware config- 
uration of the present invention is conceptually illu- 
strated. The Figure illustrates a computer system for 
generating a window-based graphic user interface in 
accordance with the teachings of the present inven- 
tion. As illustrated, the computer system includes a 
computer 20 which comprises four major compo- 
nents. The first of these is an input/output (I/O) circuit 
22, which is used to communicate information in ap- 
propriately structured form to and from other portions 
of the computer 20. In addition, computer 20 includes 
a central processing unit (CPU) 24 coupled to the I/O 
circuit 22 and to a memory 26. These elements are 
those typically found in most computers and, in fact, 
computer 20 is intended to be representative of a 
broad category of data processing devices. 

Also shown in Figure 1 is a keyboard 30 for input- 
ting data and commands into computer 20 through the 
I/O circuit 22, as is well known. 

Similarly, a CD ROM 34 is coupled to the I/O cir- 
cuit 22 for providing additional programming capacity 
to the system illustrated in Figure 1. It will be appre- 
ciated that additional devices may be coupled to the 
computer 20 for storing data, such as magnetic tape 
drives, buffer memory devices, and the like. A net- 
work interface 36 is coupled to both the memory 26 
and the I/O circuit 22, to permit the computer 20 to 
communicate along a network 38 which is coupled to 
other system resources. For example, in a video edit- 
ing environment, the computer 20 may be coupled 
over the network 38 to a video tape recorder 40, a mu- 
sic synthesizer 42, an audio tape recorder 44, and, 
special effects resource 46, as shown. 

A display monitor 50 is coupled to the computer 
20 through the I/O circuit 22. Any well know variety of 
cathode ray tube (CRT), liquid crystal or other dis- 
plays may be utilized as display 50. A cursor control 
device 52 includes switches 54 and 56 for signalling 
the CPU 24 in accordance with the teachings of the 
present invention. Cursor control device 52 (com- 
monly referred to as a "mouse") permits a user to se- 
lect various command modes, modify graphic data, 
and input other data utilizing switches 56 and 54. 
More particularly, the cursor control device 52 per- 
mits a user to selectively position a cursor 58 at any 
desired location on a display screen 60 of the display 
50. As illustrated in Figure 1, the cursor 58 is disposed 
with a window 65 in the present invention's graphic 



user interface, to be described more fully below. 
Moreover, in the presently preferred embodiment, the 
present invention's window-based user interface is 
generated and displayed using software stored in 

5 either memories 26,32 or CD ROM 34, and executed 
by the CPU 24. 

In the presently preferred embodiment, cursor 
control 52 utilizes well known apparatus and meth- 
ods for signalling CPU 24 of positional changes or 

10 cursor 58 by movement of the cursor control over a 
surface. However, it will be appreciated by one skilled 
in the art that a variety of well known cursor control 
devices may be utilized by the present invention, in- 
cluding other control devices such as mechanical 

15 mice, trackballs, joy sticks, graphic tablets, other key- 
board inputs and the like. The cursor control 52 in Fig- 
ure 1 is intended to encompass all such equivalent de- 
vices. For convenience in this specification, the cur- 
sor control device 52 and the equivalents thereof, are 

20 collectively referred to a "mouse". 

Referring now to Figure 2, the display screen 60 
of the display 50 is shown in additional detail. Illustrat- 
ed within the display 60, is a graphic user interface 
which includes a working area 1 00, a title bar 1 02 and 

25 a function bar 104, as illustrated. The function bar 
104 includes a plurality of button functions which may 
be selected by the user, including a system setup 
function 106, a production log 108, a device controller 
110, mast lists 112, edit control 114, edit bins 116, an 

30 audio mixer 188, special effects 120, a view source 
function 122, tool functions 124 and a production di- 
rectory 126. It will be appreciated by one skilled in the 
art, that the functions illustrated in Figure 2 are rep- 
resentative of a broad category of functions which 

35 may be utilized by the present invention. For exam- 
ple, although the present invention is illustrated with 
reference to a video edit graphic user interface, it will 
be appreciated that numerous functions may be ap- 
plicable for use in conjunction with the present inven- 

40 tion in other systems beyond that of video editing. 

The working area 100 comprises the "real" work- 
space of the display screen 60 which is visible to the 
user. The working area 1 00 is defined by a length 1 30 
and width 132. For purposes of this specification, the 

45 working area 100 comprises the real desktop space 
in which the user may operate on the functions select- 
ed from the function bar 104. Additionally, as shown, 
a cursor 136 is provided which is controlled by using 
cursor control device 52, as previously described with 

so respect to Figure 1, and discussed more fully below. 

Utilizing the teachings of the present invention, a 
"virtual" workspace is also defined which includes 
areas 140 and 145 in Figure 2. The "desktop" avail- 
able to a user comprises the combined length of the 

55 real and virtual working areas and is defined by 
length 150 and the width 132, as shown in Figure 2. 
Accordingly, the total workspace available in the 
desktop metaphor to the user of the present invention 
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is the combined areas 100, 140 and 145. However, 
since the desktop of the present invention may be hor- 
izontally panned, the virtual and real workspaces dy- 
namically change. Therefore, for purposes of this 
specification, the real workspace constitutes that 
portion of the desktop visible to the user, and the vir- 
tual workspace constitutes that portion of the desktop 
which is not visible to the user at any one time. Al- 
though not visible to the user, for purposes of explan- 
ation in this specification, the virtual workspace is il- 
lustrated using dashed lines in the figures. It will be 
noted that although Figure 2 illustrates the present in- 
vention increasing the length of the available work- 
space but not the width, that other embodiments of 
the present invention may increase both the vertical 
and horizontal lengths and widths of the total work- 
space. 

Referring once again to Figure 2, as shown, cur- 
sor 136 includes a left arrowhead 165 and a right ar- 
rowhead 168. As will be described, the workspace 
comprising the virtual workspaces 140 and 145 and 
real workspace 100, may be panned left or right by 
depressing an appropriate switch 54 or 56 on the cur- 
sor control device 52. The depression of left switch 56 
results in the workspace being panned horizontally to 
the left and in the direction of the arrowhead 165. 
Similarly, the depression of switch 54 results in the 
workspace panning right in the direction of arrowhead 
168, as will be illustrated. A button function such as 
system setup 106 may be selected by placing cursor 
1 36 over a portion of the function on the function bar 
104 and momentarily clicking either switch 54 or 56 
on the cursor control device 52. In the presently pre- 
ferred embodiment, the movement of the cursor 136 
over the function bar 104 results in a modification of 
the visual appearance of the cursor to that of a single 
arrow. (See cursor 58 in Figure 1). Subsequent to the 
selection of a function on the function bar 104, the 
movement of the cursor 136 into the working area 
100, results in the modification of the visual appear- 
ance of the cursor once again, such that the cursor 
136 appears as shown in Figure 2. 

Referring now to Figure 3, the button function 
system setup 106 has been selected by a user. Sys- 
tem setup window 170 includes a drag bar 175 for se- 
lectively moving the window 170 over the working 
area 100. In operation, the cursor 136 is placed over 
a portion of bar 1 75, and a switch (either switch 54 or 
56) on cursor control device 52 is depressed. The win- 
dow 1 70 may then be selectively dragged to any lo- 
cation within the working area 100 and positioned for 
the convenience of the user. As shown, window 170 
further includes a close box 180 which may be acti- 
vated to close window 170 and redisplay the button 
function on the function bar 104. The window 170 
may be closed by placing the cursor 136 over a por- 
tion of box 180 and momentarily depressing ("click- 
ing") a switch on cursor control device 52. 



As illustrated in Figure 3, the activation of any 
one of the functions identified and displayed along 
the function bar 104 results in the opening of a cor- 
responding window (in the example illustrated in Fig- 

5 ure 3, window 170). It will be appreciated by one skil- 
led in the art that the functions illustrated in Figure 3 
and disposed in the function bar 104 are examples of 
the type of functions which may be utilized using the 
teachings of the present invention. Depending on the 

10 particular application in which the graphic user inter- 
face of the present invention is used, numerous other 
functions may be displayed along the function bar 
1 04. Additionally, as i llustrated in Figure 3, and the re- 
maining figures in this specification, each of the win- 

15 dows (for example window 1 70) corresponding to the 
functions displayed along function bar 104 have 
unique characteristics. Depending on the function 
which is selected, the window may comprise the con- 
trol panel of the video editing device, such as an audio 

20 mixer, video tape recorder or the like, or may include 
areas in which text, graphics, or moves (such as for 
example, various scenes and takes) are displayed. 
Accordingly, it will be appreciated that the functions 
illustrated in the figures are for illustration only, and 

25 that in particular window characteristics shown are 
not to be considered limitations on the present inven- 
tion. 

Referring again to Figure 3, window 170 includes 
a floating window activation button 200. As i llustrated 

30 in Figure 3, the button 200 in the presently preferred 
embodiment, includes the notation "UP" (or alterna- 
tively down "DN"). As will be described, the present 
invention permits a user to selectively set each 
opened window on the desktop (comprising both the 

35 real area 1 00 and virtual areas 145 and 140) to either 
float above the desktop, or appear to the user to be 
affixed to the desktop. In the present embodiment, 
upon selecting a function along the function bar 104, 
each window is opened (for example window 170) 

40 with the floating window activation button 200 select- 
ed by default in the "UP" (not affixed) configuration. 

Referring now to Figure 4, the operation of the 
present invention will be described when the floating 
window activation button 200 is in the "UP" (not af- 

45 fixed) position for window 170. As illustrated, window 
170 "floats" above the desktop comprising the real 
working area 100 and virtual areas 145 and 140. The 
window 170 floats above the desktop such that it re- 
mains in the same relative position as viewed by the 

so user regardless of which direction the desktop is pan- 
ned. In the example illustrated, switch 54 has been 
depressed by the user, such that the desktop has pan- 
ned to the right in the direction of arrowhead 168. As 
shown, although the desktop has panned to the right, 

55 the window 1 70 remains stationary with respect to the 
user. 

Referring now to Figure 5, window 1 70 is illustrat- 
ed with the floating window activation button 200 in 
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the down ("DN") position. In addition, the audio mix 
button function has been activated by a user, result- 
ing in the display of the audio mix window 210. As 
shown, window 210 includes a floating window acti- 
vation button 215 which is in the "UP" position, and 
thereby results in the window 210 floating above the 
working area 100 in a position fixed relative to the 
user. 

Assume for the sake of example that the user de- 
sires to pan the desktop illustrated in Figure 5 to the 
right. In accordance with the teachings of the present 
invention, the user depresses switch 54 on the cursor 
control device 52, thereby panning the desktop to the 
right as viewed by the user (in the direction of arrow 
168). As shown in Figure 6, panning the desktop to the 
right in the direction of arrow 168, results in the win- 
dow 170 being obscured from view as it passes out 
of area 100 and into the virtual desktop 140 (shown 
for illustration in dashed lines). As previously descri- 
bed with reference to Figure 5, activation button 200 
of the window 170 was selected by the user to be in 
the down ("DN") position, and accordingly, the win- 
dow 170 moves relative to the user as if it is affixed 
to the desktop. As such, the window 1 70 pans with the 
desktop, whether to the right or to the left, as the 
desktop is panned by the user using the cursor con- 
trol device 52. However, as shown in Figure 6, audio 
mix window 210 remains stationary in space relative 
to the user, such that it appears to "float" over the 
desktop. Since window 210 floats over the desktop, 
it does not move relative to the user as the desktop is 
panned right or left. Additionally, it will be again noted 
that although window 170 is shown in Figure 6 in 
dashed lines, that the dashed lines are for illustration 
only, and that the present embodiment, those items 
illustrated in the figures in dashed lines are not visible 
to the user, since they fall outside of the real working 
area 100 of the desktop which comprises the screen 
60. 

Referring now to Figure 7, subsequent to the pan- 
ning right illustrated in Figure 6, Figure 7 shows the 
panning left of the desktop by the user. In the present 
embodiment, the user depresses switch 56 on cursor 
control device 52 to initiate panning left (in direction 
of arrow 165 on cursor 136). As illustrated in Figure 
7, window 21 0 remains stationary in space and floats 
over the desktop as a result of activation button 215 
being in an "UP" position. However, as illustrated in 
Figure 7, window 1 70 has moved such tat it is partially 
visible in the real working area 100 as the desktop is 
panned left by the user. As illustrated in Figure 8, con- 
tinuing to pan the desktop left in the direction of arrow 
165 results in the window 170 appearing to traverse 
the real working area 100, and moving partially into 
the virtual desktop area 145 as the desktop is pan- 
ned. 

Referring now to Figure 9, there is shown an ex- 
ample of the present invention in which three windows 



are simultaneously open and active. There is shown 
window 210 in which floating window activation but- 
ton 215 is in an "UP" position, and window 170 in 
which the activation button 200 has been selected to 

5 be in a down ("DN") position. In addition, a window 
230 has been opened in which the activation button 
235 has been selected by the user to be in a down 
("DN") position, thereby affixing it to the desktop. It 
should be noted that since window 210 floats above 

10 the desktop, that it appears to be "closer" to the user 
and thereby overlays windows which have been af- 
fixed to the desktop by being placed in a down ("DN") 
position (in the present example, windows 170 and 
230). 

15 Assume for the sake of example that a user de- 

sires to pan the desktop of the present invention to the 
left (in the direction of arrow 165). The user depress- 
es switch 56 on cursor control device 52 and the desk- 
top pans to the left relative to the user facing the dis- 

20 play. As illustrated in Figure 10, window 210 remains 
stationary in space relative to the user since the func- 
tion 215 is in the UP (floating) position. Also illustrat- 
ed in Figure 10 is the movement of windows 230 and 
1 70 relative to the user as the desktop pans left. As 

25 shown, window 1 70 is only partially visible, with a por- 
tion of window 170 having entered the virtual work- 
space 145. Similarly, as shown in Figure 10, window 
230 has passed behind the window 21 0 and is partial- 
ly obscured by window 210. 

30 Referring to Figures 11 a- 11c, the operation of the 

present invention is conceptually illustrated to assist 
the reader in understanding the present invention's 
overall function and utility. As previously described, 
the desktop of the present invention includes the real 

35 working area 100 (real workspace) and virtual areas 
140 and 145 (virtual workspace). Thus, the entire 
desktop comprising the graphic user interface of the 
present invention includes areas 100, 140 and 145 
having an overall length identified in figure 11 as 

40 length 250. Assume for the sake of example that win- 
dow 170 is set such that the floating window activa- 
tion button function 200 is in an UP (floating) position. 
In addition, assume for the sake of example that win- 
dow 210 has been selected such that the activation 

45 button 2315 is in the down ("DN") position. As illu- 
strated in Figure 11, window 230 is provided in which 
the activation button 235 has been selected by the 
user to be in the UP position. An additional window 
300 is illustrated in which its activation button 310 is 

50 in down ("DN") position. A centre line 320 conceptu- 
ally represents the centre line of the real working area 
100, comprising display screen 60 as viewed by the 
user. 

As illustrated in Figure 11b, panning the desktop 
55 to the right results in the system window maintaining 
its position relative to the centre line 320 and the user 
since the floating window activation function button 
200 is in an UP (unaffixed) position. Similarly, win- 
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dow 230 remains fixed relative to the user since its 
activation button 235 is in an UP position as well. Dur- 
ing the panning of the desktop to the right, window 
210 moves with the desktop as a result of activation 
button 215 being in a down (affixed) position, as does 
window 300 as illustrated in Figure 11b. 

Referring now to Figure 11c, panning to the left is 
shown in which windows 170 and 230 maintain their 
same relative position to the user and float above the 
desktop. Windows 210 and 300 being "affixed" to the 
desktop move with the desktop to the left, as shown 
in Figure 11c. 

Accordingly, the present invention as described 
provides an improved graphic user interface for use 
in a window-based display system. While the present 
invention has been described with reference to Fig- 
ures 1 through 11, it will be appreciated that the fig- 
ures are for illustration only, and do not limit the spirit 
and scope of the invention. For example, all of the fig- 
ures may have, by necessity, used example windows 
having certain attributes and/or functions, it will be 
appreciated that the invention is not limited by the 
specific examples provided. 

In addition, although the present invention has 
been described with respect to panning only to the left 
or right, it will be appreciated by one skilled in the art 
that vertical panning using the teachings of the pres- 
ent invention may also be provided. Moreover, it will 
be noted that the present invention may be realized 
using a variety of computer programming languages 
and hardware, and is not limited to any particular 
hardware or software. In as much as the various fea- 
tures and aspects of the present invention are not sta- 
tic events, and are perceived by the user as having 
motion, the reader is referred to a video tape entitled 
"Graphical User Interface Incorporating A Horizontal 
Panning Workspace" submitted by the applicant con- 
current with the filing of the application on which this 
patent is based. 



Claims 

1. A computer display system including a central 
processing unit (CPU) coupled to a display hav- 
ing a display screen, such that data is displayed 
on said display screen in a plurality of windows, 
comprising: 

user interface generation means coupled 
to said CPU for displaying said data in said win- 
dows, said user interface generation means gen- 
erating and displaying a user interface including 
a desktop having a visible portion and a virtual 
portion, wherein said visible portion corresponds 
to that portion of the said desktop currently visible 
on said display screen, said virtual portion corre- 
sponding to that portion of said desktop currently 
not visible to said user on said display screen; 



panning means coupled to said CPU for 
selectively panning said desktop in at least two 
directions, such that said desktop pans in a direc- 
tion selected by a user, and that portion of said 
5 desktop within said visible portion is visible to 

said user. 

2. The display system as defined by claim 1 , where- 
in said windows displayed on said desktop in- 
to elude attachment means for selectively affixing 

at least one of said windows to said desktop, such 
that if a window is affixed to said desktop said 
window moves with said desktop in the direction 
said desktop is panned, and remains stationary 
15 relative to said desktop. 

3. The display system as defined by claim 2, where- 
in in the event said window is not affixed to said 
desktop, said window remains stationary with re- 

20 spect to said user, such that said unaff ixed win- 

dow appears to said user to float above said 
desktop as said desktop is panned. 

4. The display system as defined by claim 3, where- 
25 in said panning means includes a cursor control 

device coupled to said CPU and operable by said 
user. 

5. The display system as defined by claim 3 or 4, 
30 wherein said attachment means includes a float- 
ing window activation button in each of said win- 
dows displayed on said display having two states, 
a first state corresponding to an affixed state and 
a second state corresponding to said unaffixed 

35 state. 

6. The display system as defined by claim 5, where- 
in said activation button displays the notation DN 
if said function has been placed in said affixed 

40 state. 

7. The display system as defined by claim 6, where- 
in said activation button displays the notation UP 
if said function has been placed in said unaffixed 

45 state. 

8. The display system as defined by any one of 
claims 3 to 5, further including a function baron 
said display screen on which is displayed a plur- 

50 ality of functions selectable by said user. 

9. The display system as defined by Claim 8 where- 
in said function bar is horizontally disposed along 
the lower portion of said display screen. 

55 

1 0. The display system as defined by claim 9, further 
including a title bar disposed horizontally across 
the top of said display screen. 
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11. The display system defined by Claim 10 wherein 
said function bar remains stationary relative to 
said user. 



15. The display system as defined by claim 4, where- 
in said desktop further includes a cursor dis- 
played on said display screen and controlled by 
said cursor control device, said cursor having the 
shape of an arrow including a body and two op- 
posing arrow heads, one of said arrow heads 
pointing left and one arrow head pointing right 



17. The display system as defined by claim 16, 
wherein if said cursor is placed by said user using 
said cursor control device over one of said win- 
dows displayed on said desktop, said CPU modi- 
fies the shape of said cursor. 

18. The display system as defined by claim 17, 
wherein said modified cursor has the shape of an 
arrow having only a single arrow head. 

19. In a computer display system including a central 
processing unit (CPU) coupled to a display hav- 
ing a display screen, such that data is displayed 
on said display screen in a plurality of windows, 
a method for increasing the usable workspace for 
a user comprising the steps of: 

generating and displaying a user interface 
including a desktop having a visible portion and 
a virtual portion, wherein said visible portion cor- 
responds to that portion of said desktop currently 
visible on said display screen, and virtual portion 
corresponding to that portion of said desktop cur- 
rently not visible to said user on said display 
screen; 



panning said desktop in at least two direc- 
tions, such that said desktop pans in a direction 
selected by a user, and that portion of said desk- 
top within said visible portion is visible to said 
user; and 

selectively affixing at least one of said win- 
dows to said desktop, such that if a window is af- 
fixed to said desktop said window moves with 
said desktop in the direction said desktop is pan- 
ned, and remains stationary relative to said desk- 
top. 

20. The method as defined by claim 19, wherein in 
the event said window is not affixed to said desk- 
top, said window remains stationary with respect 
to said user, such that said unaff ixed window ap- 
pears to said user to float above said desktop as 
said desktop is panned. 

20 21. The method as defined by claim 20, wherein said 
user uses a cursor control device coupled to said 
CPU and operable by said user to pan said desk- 
top. 

22. The method as defined by claim 20, wherein each 
of said windows includes a floating window acti- 
vation button having two states, a first state cor- 
responding to an affixed state and a second state 
corresponding to said unaffixed state. 

23. The method as defined by claim 22, wherein said 
activation button displays the notation DN if said 
function has been placed in said affixed state. 

35 24. The method as defined by claim 23, wherein said 
activation button displays the notation UP if said 
function has been placed in said unaffixed state. 

25. The method as defined by claim 20 further in- 
40 eluding a function bar on said display screen on 

which is displayed a plurality of functions select- 
able by said user. 

26. The method as defined by claim 25, wherein said 
45 function bar is horizontally disposed along the 

lower portion of said display screen. 

27. The method as defined by claim 26 further in- 
cluding a title bar disposed horizontally across 

50 the top of said display screen. 

28. The method as defined by claim 27, wherein said 
function bar remains stationary relative to said 
user. 

55 

29. The method as defined by claim 27, wherein said 
title bar pans with said desktop. 



12. The display system as defined by claim 10, 5 
wherein said title bar pans with said desktop. 

13. The display system as defined by any one of 
claims 3 to 12, wherein in the event said windows 
overlay one another on said desktop, windows 10 
unaffixed to said desktop appear to said user to 
float above windows which are affixed to said 
desktop. 

14. The display system as defined by claim 13, 15 
wherein said panning is horizontal. 



with respect to said user viewing said display, 25 
said arrow heads corresponding to panning direc- 
tions of said desktop. 

16. The display system as defined by claim 15, 

wherein said cursor control device includes at 30 
least two switches coupled to said CPU, said 
switches corresponding to said panning direc- 
tions. 



8 



15 EP 0 613 080 A2 16 

30. The method as defined by claim 20, wherein in 
the event said windows overlay one another on 
said desktop, windows unaff ixed to said desktop 
appear to said user to float above windows which 

are affixed to said desktop. 5 

31. The method as defined by claim 30, wherein said 
panning is horizontal. 

32. The method as defined by claim 21 , wherein said 
desktop further includes a cursor displayed on 
said display screen and controlled by said cursor 
control device, said cursor having the shape of an 
arrow including a body and two opposing arrow 
heads, one of said arrow heads pointing left and 
one arrow head pointing right with respect to said 
user viewing said display, said arrow heads cor- 
responding to panning directions of said desktop. 

33. The method as defined by claim 32, wherein said 20 
cursor control device includes at least two 
switches coupled to said CPU, said switches cor- 
responding to said panning directions. 

34. The method as defined by claim 33, wherein if 
said cursor is placed by said user using said cur- 
sor control device over one of said windows dis- 
played on said desktop, said CPU modifies the 
shape of said cursor. 

35. The method as defined by claim 34, wherein said 
modified cursor has the shape of an arrow having 
only a single arrow head. 

35 
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